Probalistic Network Construction Using the Minimum Description Length Principle
نویسنده
چکیده
Probabilistic networks can be constructed from a database of cases by selecting a network that has highest quality with respect to this database according to a given measure. A new measure is presented for this purpose based on a minimum description length (MDL) approach. This measure is compared with a commonly used measure based on a Bayesian approach both from a theoretical and an experimental point of view. We show that the two measures have the same properties for innnite large databases. For smaller databases, however, the MDL measure assigns equal quality to networks that represent the same set of independencies while the Bayesian measure does not. Preliminary test results suggest that an algorithm for learning probabilistic networks using the minimum description length approach performs comparably to a learning algorithm using the Bayesian approach. However, the former is slightly faster.
منابع مشابه
Learning Bayesian Belief Networks Based on the MDL Principle: An Efficient Algorithm Using the Branch and Bound Technique∗
In this paper, the computational issue in the problem of learning Bayesian belief networks (BBNs) based on the minimum description length (MDL) principle is addressed. Based on an asymptotic formula of description length, we apply the branch and bound technique to finding true network structures. The resulting algorithm searches considerably saves the computation yet successfully searches the n...
متن کاملPaper Learning Bayesian Belief Networks Based on the Minimum Description Length Principle: Basic Properties
SUMMARY This paper addresses the problem of learning Bayesian belief networks (BBN) based on the minimum description length (MDL) principle. First, we give a formula of description length based on which the MDL-based procedure learns a BBN. Secondly, we point out that the diierence between the MDL-based and Cooper and Herskovits procedures is essentially in the priors rather than in the approac...
متن کاملLearning Bayesian Belief Networks Based on the Minimum Description Length Principle : Basic Properties ∗
SUMMARY This paper addresses the problem of learning Bayesian belief networks (BBN) based on the minimum description length (MDL) principle. First, we give a formula of description length based on which the MDL-based procedure learns a BBN. Secondly, we point out that the difference between the MDL-based and Cooper and Herskovits procedures is essentially in the priors rather than in the approa...
متن کاملLearning Bayesian Belief Networks Based on the Mdl Principle: an Ecient Algorithm Using the Branch and Bound Technique 1
In this paper, the problem of learning a Bayesian belief network (BBN) from given examples based on the minimum description length (MDL) principle is addressed. Given examples, the learning algorithm based on the MDL principle computes for each network the total of description length of the network and that of the examples given the network, and nds a network with the minimum value. We provide ...
متن کاملGenetic Programming Using a Minimum Description Length Principle
This paper introduces a Minimum Description Length (MDL) principle to de ne tness functions in Genetic Programming (GP). In traditional (Koza-style) GP, the size of trees was usually controlled by user-de ned parameters, such as the maximum number of nodes and maximum tree depth. Large tree sizes meant that the time necessary to measure their tnesses often dominated total processing time. To ov...
متن کامل